I've not tried it with IMSMO yet but I have used AD to authenticate Traveler devices.
First, get DA configured to use AD (which you've done, this is for others) http://www-01.ibm.com/support/docview.wss?uid=swg21293255. Choose an AD attribute to contain the Domino CN and populate.
Second, fill in the person document fields LTPA user name (this is the AD CN) and Active Directory (kerberos) logon name (this is LogonName@DOMAIN.NAME format).
Third, create Web SSO config doc and enable Windows single sign-on integration and enable Map names in LTPA tokens.
Forth, add the SSO config to your website doc and set the session authentication to Multiple Servers (SSO)